General Disclaimer 


One or more of the Following Statements may affect this Document 


• This document has been reproduced from the best copy furnished by the 
organizational source. It is being released in the interest of making available as 
much information as possible. 


• This document may contain data, which exceeds the sheet parameters. It was 
furnished in this condition by the organizational source and is the best copy 
available. 


• This document may contain tone-on-tone or color graphs, charts and/or pictures, 
which have been reproduced in black and white. 


• This document is paginated as submitted by the original source. 


• Portions of this document are not fully legible due to the historical nature of some 
of the material. However, it is the best reproduction available from the original 
submission. 


Produced by the NASA Center for Aerospace Information (CASI) 



N83- 17089 


(HASi-CB-169650) AIECH&PT-7EHICIE SYSTEH 
IHTEGACTIOM. AM EVALOATIOii OF MA£A*S 
FBOGSAH IH HUMAN FACTORS RESEAFCB (National 
Acadeay of Sciences - Maticnal Research) 

Qt p HC A0 3/HF AO I CSCL 05H G3/54 


Aircrew-Vehicle System Intera 

An Evaluation of 
NASA's^r^gram In 
MumaifFactors 


unci as 
15289 







• k 





i 


■ . ') — -v - 

\ ■' ■ ■ . :■ 

Aeronautics and Spate Engineering Board 

Commission on Engineering and Technical Systems 
National Research Coundl 




V 


\ 







Aircrew-Vehicle System Interaction 


An Evaluation of 
NASA's Program in 
Human Factors Research 


Report of the ad htK Committee on 
Aircrew- Vehicle System Interaction 


Aeronautics and Space Engineering Board 
Commission on Engineering ? J Technical Systems 
National Research Council 


national ACADEMY PRESS 
Washington, D.C. 1982 


NOTICE: T\wi project that la the subject of this report vas approved 

by the Covet nitig Board of the National Research Council » whose aeabers 
are drawn from the councils of the National Academy of Sciences, the 
National Academy of Engineering, and the Institute of Medicine* The 
members of the committee responsible for the report were chosen for 
their special competences and with regard for appropriate balance* 

This report has been reviewed by a group other than the authors 
according to procedures approved by a Report Review Committee 

consisting of members of the National Academy of Sciences, the 
National Academy of Engineering, and the Institute of Medicine* 

The National Research Council was established by the National 

Academy of Sciences in 1916 to associate the broad community of 
science and technology with the Academy's purposes of furthering 
knowledge and of advising the federal government* The Council 
operates in accordance with general policies determined by the Academy 
under the authority of its congressional charter of 1863, which 
establisl^s the Academy as a private, nonprofit, self-governing 

membership corporation* The Council has become the principal 

operating agency of both the National Academy of Sciences aud the 

National Academy of Engineering in the conduct of their services to 
the government, the public, and the scientific and engineering 
communities* It is administered Jointly by both Academies and the 
Institute of Medicine* The National Academy of Engineering and the 
Institute of Medicine were established in 1964 and 1970, respectively, 
under the charter of the National Academy of Sciences* 

This report and the study on which it is based were supported by 
Contract No* NASW-3433 between the National Aeronautics and Space 
Administration and the National Academy of Sciences* 

Copies of this publications are available from: 

Aeronautics and Space Engineering Board 
National Research Council 
2101 Constitution Avenue, N*W* 

Wash! i\g ton, D*C* 20418 


AD HOC COMMITTEE ON AIRCREW-VEHICLE SYSTEM INTERACTION 


Gordon Sim, Chalroan 
Vice President 
Pregram Management 
and Technology 
Rohr Industries, Inc. 

David R. Ellis 
Supervisor, Advanced Design 
and Systems Research 
Cessna Aircraft Company 

John H. Enders 
President 

Flight Safety Foundation, Inc. 

Delmar M. Fadden 
Maudger of the 757/767 

Flight Deck Integration Group 
The Boeing Company 

Albert A. Friuk 
Formerly Vice President, 

Flight Training 

Pan American World Airways, Inc. 

Richard F. Gabriel 

Chief Human Factors Engineer 

Douglas Aircraft Company 


Deanna S. Kltay 
Assistant Professor 
of Neurosurgery 
Department of Surgery 
University of Texas 

Charles 0. Miller 
President 

System Safety, Inc. 

Stanley N. Roscoe 
Professor and Head, 

Behavioral Engineering 
Laboratory 

New Mexico State University 

William L. Rutherford 
Commorclnl Transport Pilot 
United Airlines 

Archie T. Sherbert, Jr. 
Manager, Advanced Aircrew 
System Design 
Boeing Vertol Company 

Thomas B. Sheridan 
Department of Engineering and 
Applied Psychology 
Massachusetts Institute of 
Technology 


ill 


Llaleon Representatives 


Neal A. Blake 

Deputy Associate Adainistrator 
for Eoglneerlng & Developaent 
Federal Aviation Adalnlstration 

Paul R. Chateller 
Office of Under Secretary of 
Defense Research & Engineering 
The Pentagon 

Thoaas larlch 
Assistant Chief, Flight 
Standards Division 
Northwest Region 
Federal Aviation Administration 


Staff 


Albert J» Evans 
Project Officer 

Laura D'Sa 

Administrative Secretary 


iv 


PREFACE 


NASA's role relating to huaan factors in aviation Is found In Its 
charter*: 

o To direct and exercise control over the research Into and the 
solution of problems of flight within and outside the earth's 
atmosphere; 

o To Improve the usefulness, performance, speed, safety, and 
efficiency of aeronautical vehicles; 

0 To preserve the role of the United States as the leader in 
aeronautical science and technology* 

Since the end of World War II, NASA and its predecessor, the 

National Advisory Committee for Aeronautics, have recognized the 

critical importance of man-machine Interaction in the increasingly 
complex high technology aviation system. NASA's primary concern In 
human factors has been with the application of scientific knowledge 
and fundamental study, rather than with developmental or design 
problems. 

NASA Initiated a human factors research program at Its Ames 
Research Center in the 1950s, concentrating on pilot aircraft control 
functions, and the present Human Factors In Aviation Safety research 

program began In 1973. Today, NASA's program Is focused In two 

areas — Flight Management and Simulation Technology. 

During the last decade, the emphasis of NASA's human factors 
program has shifted from aircraft control to tne perceptual and 
cognitive skills necessary for effective decision making. 

*U.S. Senate Committee on Commerce, Science, and Transportation. 
Committee Print. National Aeronautics and Space Act of 1958, as 
Amended, and Related Legislation. 95th Congiess, 2nd Session. 
Washington, U.S. Government Printing Office. Decem^ar 1978. 
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The study of hunsn factors In flight Banageaent Is guided in 
part by an aviation safety reporting systea that provides evidence 
of deficiencies in the aviation systea that relate to the aanageaent 
of Inforaatlon among the various systea coaponents* NASA's Aviation 
Systea Reporting Systea (ASRS) was initiated five years ago at the 
request of the aviation comaunity and the FAA to collect data 
regarding operating problems and huaan errors in the aviation 
systea. Hypotheses based on these data underlie auch of NASA's 
huaan factors research and serve to Illuminate the problems on which 
work is most urgently needed. The systea has provided data and 
analytical studies for over 30 other agencies and organisations 
within and outside of the government • and Its methods are under 
study for possible adoption by other nations. 

NASA's Huaan Factors and Simulation Technology program covers 
research in all aspects of simulation^ Including hardware and 
software Improvement, computer configuration. Improved visual cue 
generation, optimal controlling methods of the pilot simulator 
systea, and training methodology for making maximum use of the 
available simulation technology. 

NASA's capability In aeronautical human factors Is enhanced by: 

1. Close ties with all eleoents of the aviation community 
through the formal mechanism of Its advisory committee 
structure and Informally through contacts %rlth DOO, FAA, 
air carriers, aviation manufacturers, and user groups; 

2. The availability of facilities Important to human factors, 
including the Flight Simulator for Advanced Aircraft and 
the Vertical Motion Simulator at Ames, and the Differential 
Maneuvering Simulator at Langley; 

3. NASA's status as an independent government agency that can 
act as an objective third party and Its history of 
responsiveness to the needs of the aviation community; 

4. A cadre of experienced human factors Investigators that, 
along with supporting staff, constitutes a group dedicated 
to finding solutions to human factors problems in aviation. 
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SUMMARY CONCLUSIONS AMD RECOMMENDATIONS 


The conaittee has reviewed NASA's program of research In *""Ran 
factors In the aircraft cockpit and a proposed program augmentation* 

In the committee's Judgment the dramatic growth of microprocessor 
technology makes it entirely feasible to automate increasingly more 
functions in the aircraft cockpit; the promise of Improved vehicle 
performance, efficiency, and safety through automation makes highly 
automated flight inevitable* However, the committee believes that an 
organized data base and validated methodology for predicting the 
effects of automation on human performance and thus on safety are 
lacking and is concerned that without such a data base and validated 
methodology for analyzing human performance, increased automation may 
introduce new risks* 

The committee concludes that NASA's effort should be concentrated 
on developing methods and techniques for analyzing man-machine 
interactions, Including human workload and prediction of performance 
and assessment of their effects on safety and reliability. Therefore, 
the committee recommends that NASA, in its program of research, 
concentrate ou providing a methodology for accomplishing a predictive 
human performance failure modes hazards analysis that could be 
Integrated with the methodology used for the failure hazards analysis 
of hardware to provide an overall system (man and macflne) hazards 
analysis methodology* In the committee's view, a comprehensive 
research effort will be required to provide a data base to support 
such a safety and reliability analysis methodology* 

The committee further recommends that the proposed program 
augmentation dealing with the allocation of functions to man and 
machine should concentrate on the acquisition of principles ana the 
development of methodologies of general applicability, leaving the 
formulation of specific guidelines for the design of interfaces 
between man and machine to the Industry* 

The committee also reviewed the research and technology 

development programs in aircrew-vehicle interaction in the Department 
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of Defense end the Fedcrel Avietlon Adainistr-ition In light of 
NASA's ongoing end plenned prograa. The conalttee concludes that 
NASA end DOD progress are as well coordinated and autually 
supportive as can practically be achieved. It notes that the FAA's 
Office of Engineering ^nd Developaent recognises that such of the 
huaan factors research and developaent needed to aeet Its 
responsibilities Is addressed In programs being conducted by NASA 
and the DOD, and continually draws upon the expertise and 
capabl .Itles of those agencies. 

The committee notes that many aircraft accidents and incidents 
are determined to have buen caused by himan error and polnta to the 
importance of determining the causes of the human error. Such 
Information is absent in records of accident investigations. Thus, 
the committee recommends that NASA explore the feasibility of 
establishing a program to Identify and evaluate the cause of the 
human error where It Is deemed to be causal In an accident or 
Incident situation and, if feasible, undertake such a program. 
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INTRODUCTION 


Safety statistics Indicate that air transportation Is the safest 
'^ods of public transportation* Aviation safety has laprovsd steadily 
over the past two decades* This is due to laprovsd reliability of 
aircraft (aade possible by technology advances in structure, 
aaterlals, engines, electronics, etc*) and laproveaents In the other 
necessary parts of the systsa (air traffic control, coaaunlcatlons, 
weather /rorecastlng, etc*)* On the other hand, the statistics also 
Indicate that aircraft accidents attributed to huaan error continue to 
occur and laply that soae of those accidents could have been prevented 
fay thi' huaans In the systea* 

Increased autosutlon to reduce huaan workload and to augaent huaan 
Inforaatlon processing and coaaunlcation is altering the role of huaan 
operators In aviation, as well as In other high technology syateao* 
However, evolving systeas, while designed to be safer and aore 
econcHslcally efficient than existing systeas, actually could be less 
safe and efficient If the changing role of the huaan operator Is not 
understood fully and planned for* 

With the rapid growth of sutoaatlon the huaan operator Is becoalng 
Increasingly a supervisor of coaputere* which In turn directly control 
the aachlnes* Thus, huaan abilities are being focused on the 

outermost control loops* However, while less huaan Involveaent 's 
required for rote tasks, the huaan supervisor is being called upon to 
oversee aore Interdependent control loope, to allocate his attention 
aaong aore displays, and to aake more complex decisions* 

While automation does not ellalnate alrcreir-vehlcle Interactions,* 
It does alter thea In ways that aay affect crew performance, and how 

*Han-*aachine Interaction refers to the coaaunlcation with and control 
of aachlnea by aen* It Is Influenced by the art and science of 

designing display and control devices and workplaces, allocating 
functions between aen and aachlnes, and selecting and training 
operators and aalntenance personnel* 
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that happana is not alwaya undaratood fully* Tha naad to dataralna 
tha cauaaa of arror In current oparatlona and to daslan futura 
qrataaa that will alniaiaa tha occurranca and af facta of huaan arror 
calla for a coaprahanalva raaaarch prograa drawing on all avellabla 
rasourcaa, Including thoaa of NASA, FAA, DOD, induatry, and acadaala. 

While the huaan factora relating to “knoba and dials** cockpit 
design are pretty well established and docmantad in hustan 
engineering guides, principles of design for ttM new 
huaan-coaputar-aircraft Interactiions are in an earlier phase of 
davelopnent • 

NASA and its predecessor, NACA, have been concerned with the 
huaan factors of slrcraf. control since very early in the hietory of 
aviation and in the 1950s initiated at the Ames Research Center a 
huaan factors research prograa that concentrated on pilot 
functlone. NASA's current prograa—Huaan Factors in Aviation 
Safety-**began in 1973. Today, the prograa is concerned with two 
areas— 'Flight Manageaent snd Siaulation Technology. 

The increasing awareness of '.he need to understand better the 
huaai side of aan-aachine interaction, and ttM awareness that 
research in huaan factors can laprove efficiency as well as aviation 
safety, has led NASA to reexaaine its profraa of research in this 
area. NASA's review has resulted in a proposed augaentation of its 
ongoing research prograa, to be focused on huaan factors in the 
aircraft cockpit. To assure that its planning is appropriate to the 
critical issues, NASA requested the National Research Council's 
Aeronautics and Space Engineering Board (ASEB) to evaluate its 
prograa. To accoaplish the requested evaluation, the ASEB 
established the ad hoc Coaaitt.ee on Aircrew-Vehicle Systea 
Interaction. The coBalttee was asked specifically to: 

o assess the appropriateness, relevance, adequacy, at^ 
tiaeliness of the prograa with respect to the needs and 

o provide recoaaendations regarding the objectives, spprosch, 
and concent of the prograa plan. 

To place the NASA prograa in context and to deteraine the degree 
of coordination and autual support aaong the governaent agencies 
with responsibilities in aviation huaan factors, representatives of 
the Oepartaent of Defense (DOD) and the Federal Aviation 

Administration (FAA) attended the coaaittee's asetlngs and the 
coaalctee received briefings describing the DOD and FAA programs of 
research and technology development in the field of aviation huaan 
factors. The DOD and FAA programs are described in Appendix A. 

The DOD effort is coordinated aaong the allitary services and 
NASA through the DOD Huaan Factors Engineering Technical Advisory 
Croup (HFE-TAG) and its subgroups. The HFB-TAG consists of 
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technical raprasantativct froa various organisational alaaanta 
of tha ailitary aarvlcaa and NASA that hava raaaarch and davalopaant 
raaponaibility in tha araa of huaan factors rnslnaaring- 

The FAA racognisea that auch of tha huaan factors raaaarch and 
davalopaant naadad to fulfill its rasponsibilltias is addreasad in 
NASA and DOD prograas* Accordingly, tha FAA draws upon .he 
axpertlsa and capabilitias of thasa aganclasi and there are a nuaber 
of prograas that are conducted Jointly by NASA and the FAA* a Office 
of Engineering and Davalopaant. 

The ad hoc Coaaittaa on Aircrew-Vehicle Systea Inteiaction, 
which la responsible for this report, aet at the NASA Anes Research 
Center, ttountaln View, California on June 24-25, 1981 and at the 
National Acadaay of Sciancas in Uashington, D.C. on October 6-7, 
1981. 


ASSESSMENT OF NASA'S PROGRAM 


NASA, recognizing the inevitable increased use of autoaated 
equipaent in the aviation systea to iaprove systea capacity and 
econ(»ics, believes that this Increased autcaation will affect the 
perforaance of pilots, air traffic controllers, and other huaan 
operators in unplanned and unexpected ways, not all of them 
desirable. In NASA's view, the data base on the capabilities and 

llaitatlons of the human(s) in the systea is inadequate, and there is 
no widely understood and accepted technology for the allocation of 
functions to man and machine. NASA predicts that, in the rush to 
apply the rapidly expanding new technology in electronics and 
avionics. Insufficient attention will be given to the effects of 
automat f 3n on the human operator(s). 

To provide the data base and technology it sees as required to 
avoid costly design and operating errors and possible hazards in 
future aircraft, NASA has proposed to augment its ongoing research 
effort in human factors. NASA's stated goal is to: 

permit timely development of a human factors technology 
base to assist the aviation connunlty in Implementing 
more highly automated systems without incurring perfor- 
mance problems in the humans who must operate those systems. 

The research program augmentation has been designed to build on 
the current ongoing program and to make use of as much past research 
and present knowledge as possible to develop new knowledge and 
technology through research in human factors. 

The ad hoc committee agrees with NASA's assessment that the 
dramatic advances being made in microprocessor technology will produce 
an equally dramatic increase in automation of aviation systems. 
Consequently, the committee also shares the concern that sufficient 
attention may not be given to the effects of such automation on the 
human operator in the system, not because the operator is overlooked, 
but because adequate data on the effects of automation on human 
performance and thus on system safety are lacking. 
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The cooaittee points out that the full r ige of huaan factors 
activity only recently has gained vide recognition as a valid 

technical field of design that is critically important to the 
conceptual design of the modern aircraft system* Because of its 
relatively recent acceptance^ it has not yet developed the required 
coherent data base of technical information and applicable 
methodologies » as have the other areas of aircraft design such as 
aerodynamics » structures » and electronics* Thus the need for 
research, not only to provide the information that will lead to 
improved designs, but also to predict, evaluate, and verify the 
value of the improvement* The committee observes that NASA is 

attempting to provide the leadership necessary to develop a data 
base and help establish direction for others in the field* 

NASA has been involved in assessing man*-machine interaction 
throughout the history of aviation* Recent major programs such as 
Short Take Off and Landing (STOLAND), Terminal Configured Vehicle 
(TCV), and the Aviation Safety Reporting System (ASRS) have been 
instrumental in identifying the nature and extent of man-machine 

interaction concerns associated with high-capability digital 
avionics* While identification of problems inherent in the 
application of new technologies is necessary to introducing them 
safely, problem identification alone is not enough* Rapid 

introduction requires an established knowledge base and validated 
assessment methodologies to permit timely and effective applications 
without incurring unreasonable risk* 

The ad hoc committee reviewed and discussed NASA's program of 
research into the human factors aspects of the aircre%r“vehicle 
system in two separate sessions* In the first session the committee 
reviewed NASA's ongoing program, and in the second session reviewed 
NASA's proposed program augmentation* 

NASA's program is described in Appendixes B and C* 


NASA's Ongoing Program 

The cooimittee's overall judgment of NASA's ongoing program is 
that the work being conducted consists of individual projects in 
which, although the projected results of each one will be valuable, 
a central guiding question or purpose to provide focus to the 
overall program is lacking* The committee believes that this 
situation can be corrected through redirection of effort in selected 
elements of the ongoing program to support the goals of the 
recommended program auguentation that is discussed subsequently* 
The committee recommends that NASA direct its program to providing 
the data base and methodology for measuring, understanding, and 
controlling human workload and predicting performance, including the 
understanding and prediction of human error* 
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NASA's oogoii^ program includss fivs elsmants: Flight Hangament 

Rsosarch, Simulation Technology, Aviation Safety, Workload/ 

Performance Neasures, and Human Response to Noise* Each of these 
elements Is described in Appendix B. The committee's sssessment of 
each element is Included In Che following paragraphs* 

The Flight Management Research element of NASA's ongoing program 
appears to be appropriate, particularly chose efforts dealing with 
the Identification of types of hman error, htnan decision making, 
and crev-error theories* Tlw work on Cte cockpit display of traffic 
information will be of value so long as It remains focused on basic 
concepts* 

The subelemenc "aut(«atlon‘’ is currently in an exploratory stage 
to define the problem area* It is intended as an introductory 
effort CO stg>port the proposed augmentation element, Man-Automation 
Function Allocation Strategies* Significant questions have to do 
with how to miniaixe crew boredom, apathy, and loss of skill, each 
of which is a cause of human error/ failure* It is the committee's 
view that much of the effort planned for this subelement of the 
ongoing program is related to the understanding and avoidance of 
human error in future systems, and it is recommended that the work 
be planned and directed to support the proposed program augmentation 
element, Man-Machine Reliability Assessment Techniques* 

The subelement “resource management” is an effort to improve 
aircrew performance by better definition and execution of the roles 
of crew members* The program originally was defined and initiated 
by NASA, and many airlines are adopting the results of the program* 
NASA's role now appears Co be largely in refining techniques and 
providing information to potential users* This is an area in which 
NASA should be looking to others to assume responsibility for 
program continuity* 

The “crew models" subelemenc is another effort that the 
committee believes would be of greater value applied to gaining a 
better understanding of human error* 

The work under Che Simulation Technology element could provide 
valuable data to enhance Che utility of simulation as a cool for 
studying and clarifying man-machine integration problems* The three 
subelements currently under way or planned are aimed at improving 
understanding of what perceptual features are impnr.:ant or how to 
provide higher fidelity of simulated elements that are now believed 
to be important* More needed is investigation of the Importance of 
the perceptual cues relative Co one another and how they 
interrelate* With regard to perceptual fidelity, a distinction must 
be made between simulator characteristics suitable for training and 
Chose required for aircraft development research* 

Experimental simulator requirements are considerably different 
from training simulator requirements* This is due to the fact that 
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the experlaentel elauletots wiy be ueed to eetlaete the ectuel 
perfonence that cea be obtained by the operetlonel cyetea* In thle 
reeearch end developnent appllcetlon* high fidelity nay be extrenely 
Important. The eltemetlve to high fidelity elmuletlon le actual 
flight teetlng of the eystM, which nay delay declalona» make 
changes very expensive * end Increase risks to test crews. 

In contrast, euch research suggests that very good transfer of 
tralnli^ can occur with relatively primitive simulation and 
relatively low fidelity. Obviously, this will depend on the 
specific tralnli^ objectives. Nevertheless, reliance on simulation 
for training of skills that are highly dependent on totally valid 
perceptual/motor cues la not a realistic objective because s<Me 
cues, particularly sustalned**motlon cues, cannot be represented 
validly. Fortunately, there Is no evidence that any specific 
sensory cues are uniquely essential to effective training. Although 
some factors potentially Important in training, such as fear and the 
mental set associated with actually flying, may not be present, 
comparable stresses can be introduced through complex mission 
scenarios and automatically adaptive side tasks. Operational 
doctrine and procedures (particularly eaergency procedures), effects 
of environmental variables, and fundamental skills already are being 
taught more effectively and econ<Msically in simulators than in their 
aircraft counterparts. 

The focus of the NASA program In this area Is considered too 
narrow. Very little Is known concerning the relative weight of the 
various cues, e.g. , how they interrelate and whether they modify 
behavior. Research on these fundamental questions would be valuable 
In many respects and would lead, ultimately, to a much superior and 
more cost effective simulation capability. It Is recommended that 
NASA restructure the Simulation Technology program element to 
include research Into sensory-perceptual-motor theory and define a 
more systematic long-term program. Hardware design, except for 
specific needs recognlxe<* as essential for fidelity of NASA research 
simulators, should be left to the manufacturers. 

The Aviation Safety element consists of two subelements, 
circadian desychronosls and the aviation safety reporting system. 
Circadian desynchronosls Is an Important problem, but the work 
should continue only if there is adequate support to undertake a 
systematic and comprehensive Investigation of the many variables 
Involved. 

The aviation safety reporting system (ASRS) that NASA manages 
provides valuable data regarding certain incidents and near misses 
In the air system that otherwise would not become known since they 
do not result In accidents or otherwise reportable incidents. With 
a continuing awareness of the nature of the system and Its 
shortcomings, the program Is providing worthwhile data and should be 
continued. 
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The intent of the work being conducted under the eleaent 
Uorkloed/Perfornance Meneuree le to develop e velid, reliable 
Methodology for eeaeuring workload, particularly aental workload, to 
aseiat in undaratanding and evaluating aan*-aachina interface 
concapta and daaigna, the goal being to aaaura that workload will be 
neither ao high nor ao low that the potential for error la 
incraaaed. Thia haa bean a controvaraial and iapcrtant iaaue that 
ia generating a great deal of reaaarch in aany ageiviiaa all around 
the world. Mo univeraal aolution haa been found and none nay be for 
soae tiae. NASA could aake a valuable contribution by coordinating 
and providing focue for other reaearchera. The Oefenae Advanced 
Reaaarch Projecta Agency (OARPA), eilitary laboratoriea, 
univeraitiea, and overaeaa organleatione are working Intenalvely on 
thia problee. It ia recoaMended that NASA take the initiative and 
work trlth othera in the field to eatabliah a eechaniae for 
coordinating the reaearch being done to dei^lop a reliable 
■ethodology for eeaaurlng phyaical and aental workload. 

The cooalttee considered the work being conducted under the 
eleaent Huaan Response to Noise on the effects of aircraft noise on 
people on the ground, and concludes that it has little in coaaon 
with the research activities in at rerw- vehicle systea 
interactions. It Is recoaaended that the work be reaoved froa the 
aircrew-vehicle interaction prograa and conducted under another 
prograa category. 


NASA's Proposed Prograa Augaentation 

In its prograa au'^entation, NASA proposes to identify gaps in 
existing knowledge concerning huaan Interaction with autoaated 
aviation systeas, to do the basic research to close these gaps, and 
to organize the results so as to be aore useful to the aviation 
cooaunlty. The knowledge gaps that require huaan factors research 
will be identified both through surveys and through evaluation of 
proaising new aodels of the huaan operator. 

NASA states that close liaison will be aalntalned with 
aanufacturers, designers, the FAA, and DOD to ensure the usefulness 
and usability of tte knowledge base generated in this prograa. The 
developaent of this knowledge base into quantitative aodels is one 
goal. However, the overrldli^ goal is to understand why human 
errors are aade, and to develop the data and aethodologles to permit 
designers to create systeas that ainialze thea. 

NASA's goal is to improve the existing knowledge base of systeas 
factors (hardware, software, procedures, etc.) that tend to induce 
huaan error. ^e objective will be to develop validated 
generallzable guidelines and not to develop hardware. Final 
validation of the guidelines to be developed will be accoapllshed in 
a few carefully selected flight tests. In those cases in which 
flight tests will be wade, an attempt will be aade to use systeas 
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that the Industry or the FAA hee developed to e breedboerd or 
prototype stage* 

The progran augneatation proposed by HASA and titled "Hunan 
Boglneerlng of Autonated Aviation Systena" conprlee four elMients: 

I* MaorAutonatlon Function Allocation Strateglee: to devel<^> 

a technology base to aid systena designers In allocetlng 
functions to nan and to nachlne and In selecting from 
eltematlve designs early In the developnent process. 

II. Men-Machlne Interface Design Guidelines: to develop a 

technology base for choosing advanced displays and advanced 
Input devices for effective Infomation transfer between 
the operator and the systen. 

III. Workload and Perfomance tteasurei^nt Methods: to devel<q> 

nethoda for assessing crew workload and performance In a 
manual/ autonated envl ronnent • 

IV. Han-Machine Reliability Assessnent Techniques ; to develop 
methodology to assess overall reliability of the 
man-machine systems. 

The first two augmentation elements, Man-Automation Function 
Allocation Strategies and Man-Machine Interface Design Guidelines, 
are Intended to provide additional knowledge that can be used In 
selecting and designing future system functions in situations In 
which automation may play a major role In man-machine systems. The 
Man-^chlne Interface Design Guidelines element focuses on methods 
of using advanced technology options to minimize Information 
transfer problems. The second two elements. Workload and 

Performance Measurement Methods and Man-Machine Reliability 

Assessment Techniques, are Intended to provide assessment tools and 
methods for evaluation of specific concepts. 

i^pendix C provides some detail regarding the planned content of 
each of the proposed program augmentation elements listed above. 

Of the four elements of the proposed program augmentation, the 
committee concludes that NASA's effort should be concentrated on 
elements III and IV — Workload and Performance Measurement Methods, 
and Man-Machine Reliability Assessment Techniques. In the 
committee's Judgment, these two critical elements are fundamental 
and well suited to NASA's capabilities. It Is recommended that NASA 
Incorporate In these two elements the tasks that are pertinent to 
them but, as presented to the committee, are Included under the 
other two elements In the progran as proposed and outlined In 
Appendix C. Further, It Is recommended that the work be focused to 
provldii^ the data base and methodology for accomplishing a 
predictive human performance failure modes analysis that could be 
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integrated with the nethodology need for the failure aodes enelyaie 
of hardware to provide a hasarda analyaia aethodology for the 
overall ayetea (aan and aachine) . 

It la the coaaittee'a Judgaent that the work on the developaent 
of aethodologiea and guidelinee contained in eleaenta 1 and II » 

NanrAutoaatlon FOnction Allocation Strategiee and ManrMachlne 
Interface Design (>uidelines» should be concentrated on the 
devel<^aent of prlnciplea and the developaent of aethodology of 
general ^>pllcability, leaving its application and the foraulation 
of specific strategies and guidelines to the industry. 

The aental workload of both aircrew and ground controllers has 
eaerged in recent years as a natter of concern internationally. 

This includes both sustained and transient deaand levels* and 
interaction with stress, fatigue, crew-aanning, procedures, air or 
ground allocation of functions, and other factors. At present there 
is little agreeswnt on how to Masure aental workload (e.g. , whether 
by physiological indices, secondary tasks, or subjective scaling), 
but an understanding of the total task loading — aental and 
physical — as well as human liaitatlons is essential to utilising the 
contributions of both man and machine most efficiently and safely. 

The question of crew size has arisen many times over the years 
in both civil and military aviation. The difficulty in dealing with 
the problem is compounded by lack of methodology and data stated in 
common scientific terminology that are reliable, organised, and in 
usable form. 

NASA's proposed approach to the program element Workload and 
Performance Measurement Methods is empirical. Involving a variety of 
pilots, aircraft types, and situations. Considering the limited 
understanding of the theoretical basis for cognitive processes, the 
experimental approach seems the most likely to produce tisKly usable 
results. This Is considered to be an Important subject and well ; 

suited to NASA capabilities. Tlw work must be accomplished 

thoroughly and objectively if it is to achieve the acceptance and j 

utility desired. The objectivity and broad scope of interests that | 

NASA can bring to bear on this subject greatly Increase the ’ 

likelihood of success. • 

NASA should examine the effect of workload, particularly under 
stress, on the performance of the operator. Assessment of 
performance is a fundamental requirement for any total system 
evaluation. Improvement In the reliability of such measurement is 
very Important. Assessment of workload is useful only If related to 
performance and performance breakdown. Methods of analyzing 
workload and performance to be obtained with alternative concepts 
would be especially useful in reducing design uncertainty and the 
need for redesign, resulting in a better product with reduced 

development cost in time and money. 
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Tb« Mcond ncoMcndad alcMnti Man*4lachln« Ktllablllty 
Aas««ra«nt Techniques » ee presented to tbs eoMilttee (see 
Appendix B» IV) » use proposed es e subteek of tbs other three 
elenente of the proposed progrea eugaentetlon* The coMlttee 
recoMsnde this eleaent be strengthened* Hhst Is needed Is both 
study of aenraechlne reliability end study of how safety Is effected 
by huaen perforaence* 

Also* the word “essessaent" generally connotes a Halted 
activity* l.e** slaply to predict and aeesure. In this Instance* It 
should include aethodology for prediction and aeasureaent and 
developaent of reaedlal options. 

To be aore descriptive of the work the coMilttee believes this 
eleaent should Include* It should be entitled: " Man-Machine Safety 

and Reliability Analysis Techniques: to develop aethodology for 

analysing overall safety and reliability of aan-aachlne systeas." 

The coaalttee believes that the subeleaents and research tasks 
required to provide the data base to peralt a systea-rellablllty 
assessaent (including a human error hasard analysis) will constitute 
a coapretwnsive research effort. It will be generic in nature and 
will, ultlaately* provide understanding of huaan error and the 
predictive design tool needed by aircraft designers and by the FAA 
for aircraft and airaan certification. 

This prograa elesMnt deals with two identified problea 
areas— prediction of huaan error and prediction of aan-aachlne 
effectiveness. The prograa eaphasis appears to be on assessaent and 
evaluation* but It Is laportant that the methodology be developed 
for use prior to the Introduction of hardware as well as for 
analysis of operating hardware. Existing slaulatlon* flight-test 
techniques* and operating hasard analysis provide the aeans for 
assessing aan-aachlne systeas once operating hardware Is available. 
An Interned late goal of developing assessaent techniques that depend 
on hands-on testing is reasonable, but a basic objective should be 
to develop aethodology that can be used for prediction and 
application throughout a systea's entire life cycle. 

A subtask of this prograa eleaent is adapt li:g and developing 
theories of huaan error. An essential step In this process will be 
the developaent of suitable definitions of huaan error. NASA should 
Involve a cross section of the aviation cowninlty in this task, thus 
assuring working definitions of error that will have broad 
applicability. 

The final step in this eleaent — that of evaluating the 
systea-wlde lapset of huaan error — can provide an analytic aeans to 
establish the relative Importance of various types of error. As 
such. It has significant potential for use as a prellalnary design 
aid. 
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Thia portion of tha propoaad prograa augsentatlon hat tha 
potantlal to provide teveral new laethodologlea of broad 
applicability* Since Boat aethodologlea can be Independent of 
apeclflc device technology, the aethoda will be uaeful for both 
dealgn aupport and evaluation and adaptable to Induatrlea other than 
aviation. 

Ifhlle extenalve work haa been done to delineate aethoda of 
analyali^ and controlling hardware fallurea (reliability engineering 
technology), relatively little haa been done to underatand and 
predict human error in relation not only to the oachlne but alao to 
•an* a total envlronoent. It la Important because failures and 
destructive accidents In systems are becoming more and more costly. 

The revolution In air vehicle reliability and avionics systems 
reliability during the past ten years makes It Important to 
establish quantitative data on man's reliability. To establllsh 
man's role In future aviation systems, his performance must be put 
Into a form that Is compatible with the equations used to establish 
Che vehicle system reliability. 

Current and next-generation aircraft can be considered to be 
transitional between man-dependent vehicles and fully automatic 
vehicles for many commercial and military missions. In future 
missions man may monitor/operate sensors while an .'utomatlc ^rstem 
flies Che mission profile. A methodology for human performance 
failure and hazards analysis, and the data base required to develop 
it and to use It, will be needed to examine and define the function 
of man In order to detendne for what functions human presence will 
be required In such a vehicle. 

The Insufficiency of available data Is critical, and the lack of 
a framework within which the data may be used effectively is also 
critical. A methodology Is needed for acconq>lishlng a predictive 
human performance failure and hazards analysis that ultimately could 
be Integrated with failure modes hazards analysis methodology used 
for hardware to provide an overall system (man and machine) hazards 
analysis methodology. In this connection, the use of such an 
analytic methodology should Include provision for feedback of 
operational Information to ascertain how systems are performing so 
that the hazards analyses can be Improved and upgraded continually. 

Human error deserves serious scientific attention. In the 
comnlttee's view, human error Is often misused as an alleged cause 
of accidents and it and its causes are little understood. The 
nuclear power Industry Just now is ordering that all operating 
plants JO a complete system safety and reliability analysis 
includli^ human errors (using fault trees, event trees, 

cause— consequence diagrams, and the like). NASA might well benefit 
by some strong liaison and technology transfer with that effort. 
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OTHER CONCERNS AND ISSUES 


As stated earlier, the prlasry task of the ad hoc ccnuiittee was to 
review and assess NA^'s prograa of research in human factors directed 
to problems of slrcrew-vehlcle system interaction and recommend any 
changes considered necessary to enhance the effectiveness of that 
program* The results of the committee's review are contained in the 
preceding sections of this report. 

During its review, the ad hoc committee exposed related issues 
that, although they have not been subjected to detailed analysis, It 
considered important enough to bring to the attention of NASA and 
others. These issues are briefly set out here. 

Many incidents and accidents are determined to have been caused by 
human error and the committee Judges It important to determine the 
cause of the human error. There Is a dearth of Information In cases 
Involving human performance, and It Is recommended that NASA explore 
the feasibility of establishing a program specifically to identify and 
evaluate the possible causes of pilot error In accidents and Incidents 
deemed to be caused by human error and to Identify how similar 
accidents and Incidents can be avoided In the future. It Is suggested 
that as a complement or extension of the Aviation Safety Reporting 
System (ASRS) project, NASA could pursue the investigation, analysis, 
and simulated re-creation of selected incidents and accidents 
Involving crew-related causes or factors. The cases selected should 
be those In which the evidence available woul„ suggest that the 
antecedent events leading to human error or errors might be expected 
to cause other pilots to make similar errors a high proportion of the 
time. 

The air traffic control system invades the cockpit of commercial 
transport and general aviation aircraft in a major way and Is a 
prominent element In the aircrew- vehicle system Interface. As 
automation of the air traffic control system and of airborne systems 
Increases, design of the aircrew-vehicle system Interfsce becomes more 
complex. It rslses questions such as: "Can pilots, with Improved 

cockpit display systems, tske on functions currently performed by the 
sir traffic controllers on the ground?” ”How will new display 
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t«ehnologl«s b« applied?** To raaolva tbaaa and other queatlona, 
better neana are needed for aodellng> teetlag» and predicting the 
effecta of varloua alternatlvea on ayatea efficiency and aafety* 

The coaalttee alao believea NASA ahould take a more hollatlc 
approach to experlaantatlon, l«e*, experlaenta ahould account for aa 
aany potentially critical varlablea aa poaalble* Hhatever their 

nuaber. If critical varlablea are held conatant In an experlaent, 
unleaa the fixed valuea are cloae to thoae found operationally, 
flndlnga can be groaaly Inaccurate when applied to operational 
altuatlona* The uae of econoalcal aultlfactor experlaental dealgna, 
pioneered by the chealcal Induatry, can reduce the coat of aviation 
experlaenta and greatly laprove the validity and generallxablllty of 
reaulca* 


APPENDIX A 


SUMMARY OF OTHER GOVERNMENT PROGRAMS IN HUNAN 
FACTORS RESEARCH IN AIRCRBN-VEHXCLE SYSTEM INTERACTION 

D«p«rtMnt of Dtfcos* 


The DOO RAD effort relevant to the Interaction of the 
pllot/eircrev end the aircraft is conducted as pert of e Training 
and Personnel Systeas Technology (TPST) prograe, supervised by the 
Office of the Under Secretary of Defense for Research and 
Engineering. 

The osjor eleaents of the prograa are: 

0 Huaan Factors 


0 Maiq>ower and Personnel 
0 Education and Training 
0 Siaulation and Training Devices 

The work of interest to the ad hoc Comittee falls under Huaan 
Factors and Siaulation and Training Devices. 

The total TPST prograa is funded at 1212 alllion in FY 1981, and 
i265 Billion is planned in FY 1982. Over 59 percent of these funds 
are devoted to advance developaent and prototyping slaulators and 
training devices. The sreas of Huaan Factors, Manpower and 
Personnel, and Education nnd Training receive the reaainlng funds in 
approxiaately equal proportions. The reason for having such a large 
proportion of the research and developaent funds devoted to training 
is that DOD spends at least ilO billion per year for training 
personnel and froa il billion to |3 billion per year for equipaent 
used in training. New high technology weapon systeas are being 
introduced into the inventory at a tiae when there appears to be a 
severe lack of qualified personnel to operate and aaintain thea 
throughout their life cycle. This trelning need, now end in the 
future, is reflected in the aajor eaphasls in ttie DOD prograa on 
slaulators and training devices. 

The distribution aaong the services, taking all funds into 
conslderstion (basic research through prototype developaent), gives 
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th« Navy 56 p«re«nt« th« Any 25 pareant, a-^d tha Air Porea 
19 parcant« Howavar, If alaulacor prototyping funda ara raaovad fron 
tha total, |125 Billion vara diatributad in FT 1981~Aray 38 pareant, 
Havy 33 parcant, and Air Forca 29 parcant* In FT 1982, tha Any will 
racaiva 35 parcant, tha Navy 35 parcant, and tha Air Forca 30 parcaitt 
of approxlaataly |144 Billion* Tha Huvy haa tha largaat prototypa 
davalopnant prograB in thia araa ainca chay ara only racantly 
davaloping and uaing aiaulatora for training in ahipboard akllla, 

Tha OOD affort ia coordinatad aaong tha nllitary aarvicaa and NASA 
through tha OOD Hunan Factor a Enginaaring Taclmical Adviaory Group 
(HFE**TAG) and ita aitbgroupa* Tha HFE**TAG conaiata of tachnical 
rapreaantativaa froa tha varioua organiaational alaaanta of aach of 
tha ailitary aarvicaa and NASA with raaaarch and davalopnant 
laaponaibility in huaan factora anginaaring* 

The elanenta of tha DOD TPST prograa that ara directly related to 
NASA's program of research end technology developaent are Huaan 
Factors end Siaulation Technology* 

Federal Aviation Adalnistration 

The Federal Aviation Act charges the FAA with reaponsibillty for 
assuring safe and effective uae of the national airspace and for 
fostering civil aeronautics and air coanerce* The FAA meets these 
responsibilities primarily through three major areas of activity: 

o Developaent, operation, aiul continuous iaprovement of tha 
air traffic control system; 

o ProBulgation of necessary regulatory action to assure that 
eleaents operating in the national airspace can and do 
operate safely: 

o Support and conduct of research and developaent required to 
improve the safety and effectiveness of operations in the 
national airspace* 

Within the last several years, there has been growing recognition 
within tha aviation coaaunlty of the iaportant link between batter 
understanding of huaan capabilities and llaitations and gains in the 
efficiency and safety of aeronautical operations* 

In response to the 1975 DOT Secretary's Task Force Baport on the 
FAA Safety Mission, the FAA undertook to enhance Its work in safety 
and to establish a coherent, coordinatad program, drawing on tha work 
of the several cognisant FAA elements and on that of other govemiMnt 
agencies (NASA and DOD)* Under the direction of the Office of System 
Engineering Management, and with tha support of FAA's Office of Flight 
Operations, Office of Aviation Safety, Air Traffic Service and Airways 
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fACllltit* S«rvlc«t • pretm iBlelatcd with the goBl of alrcrov 
«nd controlltr p«rforMne« «nhaiie«Mnt aad arror raductlon. Prograu 
wara daval^ad vltuln a aodaat b^dgat, utilising prlasrlly FAA and 
MASA raao^^reaa, vltfc aaphaaia on availabln raaoureas and facilitiaa 
within th« govarnaant. 

In late 1980 and early 1981, in part spurred by ii^raasing 
aaphaaia on the laaua of crew coaplaaant and craw workload and an 
ineraaalng aaphaaia on autoaation» FAA hold a sariaa of 

gouemaent/lndustry/uaar workshops to gain additional parspactlva on 
the problaa* Thaea workshops resulted in raconaendationa ranging froa 
general coaaanta on prograa content and execution to specific research 
la axpariaantal design aathods* 

Bach of the efforts described above resulted in raconaendationa 
for additional work and aora aai^sla on ttM problaa of huaan 
capabilities and lialf.ationa» which, it is conceded generally, 
constitutes the single noat iaportant cause of accidents and 
fatalities in aviation* 

The FAA concludes froa tlMse efforts by industry and goverment 
that, while highly valuable work baa been and is being done not only 
by NASA, DOO, and FAA, but also by industry and universities, there 
are fundaaental issues of basic aotlvation and huaan capabilities on 
which valid scientific data are clearly insufficient and on which a 
great deal of research reaalns to be done* These are objective 
aeasures of workload; acthods of reducing coaplacency, inattention, 
and boredoa; and the design of a truly optlaal balance between aan and 
aachine tasks* 

The diversity of recoaaendatiens aade to the FAA could be used to 
create a very extensive series of prograas and activities relating to 
huaan capabilities and llaltations* However, the FAA belisvea that 
its efforts should be confined specifically to its aission and 

rasponslbllities and should eaphasise those efforts with directly 

traceable links to practical actions that can save lives* FAA 

believes it should follow progress in broader gauge, basic research 
and technical and scientific investigations and support thea when they 
are perceived to be relevant* Such research should continue to be 
performed by the National Aeronautics and Space Adalnirtratlon, the 
Departaent of Defense, industry, and universitiesr with the support 
and collaboration of FAA: 

Based on this rationale, the following research and developaent 
areas clearly have a coaponent of huaan factors that aust be 

considered by the FAA. 

0 Research and studies to achieve aore scientific huaan factors 
design guidelines, acthods, and criteria froa the perspective 
of huaan capabilities and liaitations; 
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o Efforts to establish sore effective skill, knowledge, and 

experience criteria for eimen training; 

o Development of better guidelines for operational procedures 

and systea designs to achieve optiaua aircrew/ATC 

interactions as new capabilities are introduced into aircraft 
and the ATC systea; 

o Continuing analysis to identify areas in which research 

results can lead to iaproveaents in safety or systea 
perforaance* 

Under its Aircrew Perforaance Enhaoceaent and Error Reduction 
program (APEER). the FAA has a number of projects currently under way 
that address soae of the Issues in the above areas, soae of which are 
cooperative efforts with the National Aeronautics and Space 
Adalnistratios- The APEER program has provided the nucleus for the 
Aircrew Hiomo Factors program with a broadened range of concerns. 

Additional projects have been identified for Inclusion in this new 
prograa, and aoie will be identified as the work progresses. Current 
or planned FAA and Joint FAA/NASA projects are listed in Table 1. 
Projects independently planned by NASA and DOD are not shown. These 
projects are monitored by the FAA and relevant data and results 
utilized as appropriate In its prograa. 


TABLE 1 FAA Engineering and Development Human Factors 
Program (Fiscal Year 1982/1983) 


Project 

Funding ($1,000) 

Pilot Workload Measures 

784 

Aircraft Alerting Systems Flight Phase Monitoring 

836 

Pilot Factors-Navigation 

327 

Collision Avoidance System Display Design Guidelines 

270 

Head^Up Display Flight Evaluation 

522 

Data Link Weather Information 

Advanced General Aviation Display Certification 

99 

Guidelines 

- 

Private Pilot C;?rtirication ,ind Proficiency (Simulator) 

242 

Training for Improved Decision Making 

Cockpit Data Management Requirement* and Analysis 

291 

tEvedv:.*',,': National Air Space) 

200 

Separation/Navigation Standards 

- 

Cockpit Display of Traffic Information 

1,703 

C oinmuter/Air Taxi Human Factors Problems 

480 

TOTAL 

<,*54 


The FAA recognizes that much of the human factors research and 
development needed to fulfill Its responsibilities is addressed in 
programs being conducted by other government agencies. Accordingly, 
the FAA has drawn and will continue to draw upon the considerable 
expertise and capabilities in those agencies, especially NASA and DOD. 
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The huaen factors staff and facilities of NASA are perceived to 
be especially critical to the success of the FAA prograa* Jolat 
efforts such as the Cockpit Display of Traffic Infonutlon (CDTI) 
and Head-Up Display (HUD) projects are enables of such activity. 
Just as Inportant are such basic research prograas as flight deck 
autoastloot flight crew workload and perforaance assessaent, and 
slaulatlon technology. Also* NASA possesses extensive research 
facilities that can be used to evaluate various concepts such as 
line-oriented flight training (LOFT)» thus alnlalslng the need for 
the FAA to develop new research facilities. Slallarly, the basic 
and applied research being conducted by DOD In huaan engineering, 
systea operation, and aalntenance are l^K>rtant to the purposes of 
the FAA huaan factors program. 

Through established coordination channels and Interagency 
agreeaents, the FAA's Office of the Associate Adainlstrator for 
Engineering and Development continually seeks to strengthen 
interrelationships with NASA and DOD to ensure that Che expertise 
and facilities in those agencies are used as fully as possible in 
its aircrew huaan factors program. 


APPENDIX B 


DESCRIPTION OF NASA'S C»iGOING PROGRAM 


NASA's ongoing prograa includes five elements: Flight Management, 
Simulation Technology, Aviation Safety, Uorkload/Performance Measures, 
and Human Response to Noise* The program is carried on at the Ames 
and Langley Research Centers and the Dryden Flight Research Facility 
with a total of $7.7 million in funding and 78 full-time civil service 
personnel in FY 1982. The 78 civil service personnel are augmented by 
students, grantees, and contractor and support personnel who are 
funded through this program. 

Flight Management : NASA's goal in flight management research is 

to improve the scope and reliability of aircrew performance by 
providing a data base for optimum determination of crew roles, flight 
procedures, and control/display requirements. 

There are four subelements; Cockpit Display of Traffic 
Information, The Role of Automation, Resource Management, and Crew 
Modeling. 

(a) Cockpit Display of Traffic Information (CDTI)--NASA is 
carrying out a program Jointly with the FAA to assess the 
potential advantages and liabilities of CDTI. Work to date 
has been focused on developing a candidate display format and 
on part-task simulation evaluations of pilot ability to use 
CDTI for self-spacing and self -merging tasks. Upcoming work 
will focus on full-mission simulation studies in various 
scenarios so that workload assessments and possible 
detrimental effects of CDTI also can be evaluated. 

(b) The Role of Autooiation — NASA is beginning a research program 
to aid aircraft and air traffic control systems designers in 
allocating functions to man and to machine. 

(c) Resource Management — NASA seeks to develop methods of helping 
aircrews identify and apply the most effective human, 
technical, and mechanical resources to achieve safe, 
economical, and expeditious flight. Present work involves 
studying pilot responses to in-flight events, and 
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Idcntlfyli^ r«»ourc« MnagtMnt problra* in coMuttr air linn 
opcratlona. 

(d) Craw Nod«Ilng~NilSA saeks to describa pilot bahavlor in 
aathaaaticaily praciaa aodals. Thaaa aodala than are uaad to 
pradict the affacta of altarnativa cockpit and air traffic 
control ayataa dasigna and vrocaduraa* In FY 1982, 
davalopnant of a Monta Carlo aathaaatical nodal that includaa 
inputa to tha craw nanbara and probabilitiea of craw outputa 
for varioua aituationa will continua* Pravioua aodala have 
baan uaad to daacriba the behavior of aingla craw nanbara. 
Tha praaant nodal, dubbed *’PRO(^U,*’ will daacriba tha 
behavior of tha entire craw. Thla nodal than will be uaad in 
taating tha affacta of varioua typea and lavela of autonation 
on craw parfomanca. 

Sinulation Technology; Tha goal of thia work ia to incraaae tha 
capability of ainulatlon for replacing active flight tine in raaearch, 
davalopnant, and training. Three aubalenents are included In the 
FY 1982 prograa: Hotion/Vlaual Cue Subatitution, Low Viaibility Scene 

Generation, and Sinulation Fidelity Asaeaanent. 

(a) Notion/Vlauai Cue Subatitution — Efforts here are to detemine 
how nuch notion cueing can be effected using visual cues. A 
nodel of vlaual/vestibular cue interaction and a nathod of 
neasuring "slnulator notion deficit" (dlffereiue in notion 
between the aircraft and the slnulator) are being developed. 

(b) Low Visibility Scene Generation — This work Involves 
developing a nodel of fog and a method of evaluating 
candidates for sinulation techniques. 

(c) Sinulation Fidelity Assessnent — A nethod for basing level of 
slnulator fidelity in user needs has been developed and will 
be tested In FY 1982. 

Aviation Safety ;* The goal of this research is to Identify 
daficlanciea and dlacrapancles In the motional aviation systan as a 
basis for inproving tha currant systen and designing a future systan. 
It has two aubalenents; the Aviation Safety Reporting Systen and 
Circadian Desynchronosla (Jet lag). 


*It will be appreciated that the caption "Aviation Safety" as used 
hare does not Include all tha work (noat of the ranalndar of tha NASA 
progran) that contributes significantly to accident prevention and 
increasing accident survivability. 


26 


(•) Aviation Safoty Reportins SyatM (ASRS)— Tha ASRS la an FAA- 
aponaorad» NASA-nanafad Ineldant raportint tyataa* It la an 
anooynoua» nonpunltlva, voluntary, bafora-tha-accldant ayatan 
in which anyona who wltnaaaaa an unaafa occurranca can 111a a 
raport. NASA parforaa a nunbar of data baaa aaarchaa and 
atudlaa aach yaar to datact tranda* 

(b) Circadian Daaynchronoala~Thla progran la an attanpt to 
quantify tha affacta of fatigua and circadian daaynchronoaia 
on alrcraw parfomanco and to davalop aaelioratlva aaaauroa 
vhara nacaaaary. 

Workload/ Parfornaoca >teaauraa ; Tha goal of thla raaaarch la to 
davalop Improved tachnlquaa and mathoda for conducting amplrlcal 
Invastigatlona Into aviation htouin factora iaauea. During FY 1982, 
NASA plana to davalop candidate maaauraa for each of the componenta of 
workload (cognitive, paychoaotor, and eaotlonal) and evaluate their 
aenaltivlty to related factora auch aa age, experience, taak demanda, 
atreas, fatigue, and type of aircraft. Alternative approachea to auch 
evaluation include aubjective reporta and objective aeaaurea of eye 
acan, secondary task performance, and physiological correlates. In 
addition, NASA/ Ames will be generating a practical guide for selecting 
and applying workload measures. 

Human Response to Noise ; The goal of thla research is to minimise 
the effects of aircraft noise on passengers and on airport 
cosBBunities. There are three subelements of this research: 
quantification of single and multiple noises on the human ear, 
development of methods of assessing and minimising the effects of 
aircraft noise on airport cosmunitles, and development of better 
understamling of how noise and vibration combine to affect passenger 
acceptance of aircraft ride quality. 

NASA/Langley's aircraft noise synthesiser is the world's most 
advanced facility for studying the effects of aircraft noise on 
humans. Using this facility, a means for measuring the effects of 
aircraft noise on airport communities hss been developed. The 
technique, called ALAMO (Airport Noise Levels Assessment Model), is 
being validated and is being evaluated for its ability to predict the 
decrement in noise effects derivable from varying aircraft approach 
and departure flight profiles. Other work on noise effects is being 
done on assessing the validity of time-of-day weightings in cumulative 
airport noise metrics and on assessing the combined effects of noise 
and vibration in various helicopters. 
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APPENDIX C 


NASA PROPOSED PRO<%AM AUQIENTATKXI 
HUMAN ENGINEERING OF AUTOMATED AVIATION SYSTEMS 


The progrsB augaentation proposed by NASA Is coaprlsed of four 
aegaents: 

I. Mair*Autoaatlon Function Allocation Strategies 
II* Man-Machine Interface Design Guidelines 
III. Workload and Performance Measurement Methods 
IV. Man-Machine Reliability Assessment Techniques 

A statement of the goal, the resources to be allocated, and a 
narrative description of the approach to be used to obtain the goal in 
each of the proposed program segments is contained in the following 
paragraphs * 

It should be noted that in the NASA plan presented, the data 
necessary to accomplish segment IV are to be otAained from the 
research effort conducted under segments I, II and III. 

I. Man-Machine Function Allocation Strategies 

GOAL: Develop a technology base to aid systems designers in 

allocating functions to man and to machine, and in 
selecting from alternative designs early in the development 
process. 


RESOURCES: 


Fiscal Year 1983 1984 1985 1986 1987 1988 

Funding (tlOOO's) 1,950 2,350 2,000 2,000 2,400 2,400 

Direct Man-Years 8 W 10 12 14 14 
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APPROACH: 


o Perfora state-of-the-art review to develop heuristic design 
data base* The output will be a delineation of what is known 
and what is not known about huaan capabilities* liaitations, 
and tendencies with autoaated systeas* Investigation will 
not be Halted to aviation* but will include other fields 
such as power generation* autoaoblle aanufacturing* and 
ground transportation* in which experience has been accrued 
with differential sensitivities of huaan operation to 
alternative autoaated systoi designs* As with the other data 
bases developed in this prograa augaentatlon* it will be aade 
available to other researchers* the FAA* and industry* 

o Undertake research to close the knowledge gaps identified in 
the state-of-the-art review concerning the factors in 
autoaated systea design that differentially affect huaan 
perception* cognition* and perforaance. The research results 
will be used to augaent and refine aodels for predicting 
huaan perforaance in operating autoaated systeas* The 
testing of these augaented aodels through siaulatlon will in 
turn yield inforaation on gaps in understanding that need 
further research* This iterative process will result in 
aodels that will contain the best available knmrledge on the 
type* frequencies* and lapact of huaan errors that specific 
design factors tend to induce* These then will constitute 
guidelines for the allocation of functions to man and to 
aachine that will be validated through ground based 
siaulatlon and ultlaately flight test* These validated 
guidelines will be available for use by tbe industry in 
systea design and by the FAA in certification and regulation* 

o A parallel effort will be undertaken to adapt "Knowledge 
Engineering** methodology to aviation* NASA tten will develop 
guidelines for an Integrated cockpit alert and warning systea 
(ICAUS) and pilot-decision aids through: 

(1) applying "knowledge engineering” methodology; 

(2) applying the heuristic data base; and* 

(3) basic research studies on huaan capabilities* 
limitations* and tendencies, with alternative 
design characteristics for those systems* This 
will result in guidelines for determining what 
planclng and monitoring functions can and should be 
autoaated* These guidelines will be validated 
through simulation and finally through flight tests* 


II* Man-*Mtchlii« Interface Design Guidelines 

GOAL: Develop a technology base for choosing sdvsnced displays and 

advanced input devices for effective inforaation transfer 
between the operator and systea* 


RESOURCES: 


Fiscal Year 1983 1984 1985 1986 1987 1988 
Finding (ilOOO's) 350 1,000 1,350 1,700 2,200 2,700 
Direct MairYears 2 8 10 12 12 14 


APPROACH: 

Ii^ut Devices 

o Synthesise the state-of-the-art in huaan factors aspects of 
advanced input devices (keyboards, voice recognition, touch 
panels, etc.). 

This study will suaaarise which huaan capabilities and 
llaltations are iaportant deteralnants of input-device 
perforaance as well as the gaps in our understanding of how 
the related design factors affect huaan perforaance* 

o Undertake basic huaan factors studies to close the knowledge 
gaps identified in the state-of-the-art. Use the resulting 
knowledge to augaent and refine techniques to aid in the 
choice of input devices. The evaluation of the refined 
techniques will open further questions. The basic research 
will continue to address those questions throughout the 
prograa. n>e resulting techniques will allow designers to 
select suitable candidate devices for their systeas based on 
the best available knowledge of the effects of in-put device 
characteristics on the perforaance of the huaan operator* 

0 Develop guidelines based on the advantages and disadvantages 
of various input devices; validate guidelines through basic 
studies, slaulation, and flight tests. The state-of-the-art 
data base and the techniques to be developed will be coablned 
to provide guidelines on the selection of input devices. 


Advaocad Olaplaya 

0 Davalop haurlatlc data baaa to aid in chooalnt dlaplayad 
tnfonatloa and foraata* Whara poaaibla» this atudy will 
aynthaalia pravloua axparlaoca Into guldallnaa for dlaplay 
daalgn* and will Idantlfy knowladga gapa eoncarnlng tba 
affacta of dlaplay daalgn on huaan oparator parformanea* 

o Davalop guldallnaa and tachnlquaa for chooalng ayabola and 
dlaplay forwat through baalc laboratory atudlaa* alaulatlon, 
and aircraft taat* Laboratory atudlaa and aodala will ba 
uaad to further raflna tachnlquaa for dataralnlng Inforsatlon 
raqulrananta and choice of dlaplay foraata. 

0 Conduct reaaarch to dataralna huaan operator capabllltlaa and 
llaltatlona In ualng adaptive dlaplaya to davalop guldallnaa 
for tha daalgn of dlaplaya that automatically adapt to 
changing condltlona* 

III. Workload and Parforaanca'-Haaauraaant Hethoda 

GCAL: Develop aathoda for aaaaaalng crew workload and parforaance 

In a aanual/autoaated environaant. 

RESOURCES: 


Flacal Year 1983 1984 1985 1986 1987 1988 
Funding (ilOOO'a) 800 600 600 600 600 300 
Direct Man-Years 444442 


APPROACH: 

o Continue developaent of subjective workload coaponent 
aeasureaent techniques. Workload aeasures of aan-in-the-loop 
conditions are required for evaluation of existing systeas 
and for use with predictive efforts. 

o Develop predictive aeasures of cognitive and declslon-aaklng 
workload by adapting and expanding current aanually 
adalnlstered workload aeasures. The resulting aodels can be 
used to predict workload as a function of task deaanda and 
operating environaant so that workload can be assessed before 
actual slaulatlon. 

o Develop objective aeasures of cognitive* dcclslonraaklng* and 
resource-aanageaent perfotaance of the crew through basic 
studies* slaulatione, sed aircraft testing. These techniques 
will allow Identification and quantification of tha aore 
laportant deteralnants of systea perfonunce. 
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IV 


Man-H*chln« R•llabillty Ataesnaat Ttchniquet 


GOAL: 

APROACH 

NOTE: 

0 

o 

o 


Dcvalop aethodology to asstsa ovarall rallabillty of tha 
■an-machlna ayataaa* 


In tha propoaad NASA plan, tha data neceaaary to accoapllah 
this program aegaent would ba obtained from the research 
effort to be conducted under the program segments I» II, and 
III as noted. 

Syntheslae the state-of-the-art for assessing manned syatea 
reliability; highlight omissions, and degrees of success In 
previous efforts. This study will pinpoint where further 
efforts will produce the most payoff (state-of-the-art 
synthesis from the heuristic data base element In program 
segments I, II, and III). 

Undertake basic human factors studies to close knowledge gaps 
Identified above. Adapt and develop promising theories of 
human error (theories of human error. Is contained In the 
"human operator oiodels" element of program segment I). 

Develop techniques for evaluating the system-wide Impact of 
husian errors. The importance of human error Is determined by 
the Impact on overall system reliability; this program 
segment will produce techniques (e.g., simulation, tree 
analysis, hazard analysis) to evaluate the effect of human 
errors (error Impact evaluation, is contained In program 
segments I and III). 
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